Cost-Aware Query Optimization during Cloud-Based Complex Event Processing
نویسندگان
چکیده
Complex Event Processing describes the problem of timely and continuous processing of event streams. The load of Complex Event Processing systems can vary (e.g., event rates). Static resource provision leads to higher monetary costs because enough resources have to be provided to efficiently handle peak loads. Therefore, most of the time the resources will not be fully utilized. One way to achieve scalable processing and elastical resource allocation fitting varying requirements is to use Cloud Computing. Properties of Cloud Computing are the pay-as-you-go-payment model and high availability. These properties can be used in Complex Event Processing systems to minimize the monetary costs of systems while satisfying Service Level Agreements. Complex Event Processing systems must continuously optimize the event processing to adapt to varying loads without violation of Service Level Agreements. To guarantee efficiency, the optimization cost must be considered, leading to cost savings without violating the Service Level Agreements. In this work, we discuss factors, which should be considered during the optimization of cloud-based Complex Event Processing systems that use the pause-train-resume strategy to migrate operators. Furthermore, we propose heuristics to estimate the cost of these factors. In our experiments, the cost could be decreased by 15 % by using a cost-aware optimizer. This proofs that the costs of cloud-based Complex Event Processing systems can be further decreased if optimization is cost-aware.
منابع مشابه
Adaptive Energy-aware Scheduling of Dynamic Event Analytics across Edge and Cloud Resources
The growing deployment of sensors as part of Internet of Things (IoT) is generating thousands of event streams. Complex Event Processing (CEP) queries offer a useful paradigm for rapid decision-making over such data sources. While often centralized in the Cloud, the deployment of capable edge devices on the field motivates the need for cooperative event analytics that span Edge and Cloud comput...
متن کاملEvent Processing across Edge and the Cloud for Internet of Things Applications
The rapid growth of sensing devices has opened up complex event processing (CEP) for real-time analytics in Internet of Things (IoT) Applications. While CEP has traditionally been centralized, the increasing capabilities of edge devices like smart phones, and the operational needs of low latency and privacy makes it desirable to use both edge and the Cloud for distributed CEP, the former often ...
متن کاملDynamic Migration of Processing Elements for Optimized Query Execution in Event-Based Systems
This paper proposes a method for optimized placement of query processing elements in a distributed stream processing platform consisting of several computing nodes. We focus on the case that multiple users run different continuous Complex Event Processing (CEP) queries over various event streams. In times of increasing event frequency it may be required to migrate parts of the query processing ...
متن کاملContext-aware Distributed Complex Event Processing Method for Event Cloud in Internet of Things
With the rapid development of Internet of Things (IoT), enormous events are produced by various kinds of devices at high speed. Complex Event Processing (CEP) is the key part of IoT middleware which can help the user to get semantic meanings of primitive events. Context-awareness is an important feature of CEP engine. In this paper a high performance distributed context-aware CEP architecture a...
متن کاملTime-, Energy-, and Monetary Cost-Aware Query Processing in a Mobile-Cloud Database Environment
Growing demand for more mobile access to data is only matched by the growth of large and complex data. The availability and scalability of cloud resources when combined with techniques of caching and distributed computation provide tools to address these problems, but bring up new multi-dimensional optimization challenges such as execution time, monetary cost, and power consumption. The plethor...
متن کامل